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Abstract 

We combine the work of Garg and Konemann, and Fleischer with ideas from dynamic graph 
algorithms to obtain faster (1 — e)-approximation schemes for various versions of the multicom- 
modity flow problem. In particular, if e is moderately small and the size of every number used 
in the input instance is polynomially bounded, the running times of our algorithms match - up 
to poly-logarithmic factors and some provably optimal terms - the n{mn) flow-decomposition 
barrier for single- commodity flow. 

1 Introduction 

Flow problems are one of the most fundamental problems in optimization; they have a long list 
of scientific and engineering applications — see e.g. Ahuja et al. [1]. Usually, an instance of 
such problem consists of a directed graph G = {V,E,u) with capacities it : £^ — ?• M"*" on the 
arcs, and a source-sink pair (si,ti) (in case of single-commodity flow); or a set of k source-sink 
pairs {(si, tj)}i<i<A: (in case of multicommodity flow). The task is to flnd flows (/i, . . . , fk), where 
fi is a flow of commodity i from Si to ti, that optimize some objective function while each flow 
satisfies node conservation constraints and the total flow ^ifi{e) of the commodities through 
any arc e is not exceeding its capacity u{e). The simplest multicommodity flow problem is the 
maximum multicommodity flow problem - in this case the objective is to maximize the sum of 
the flows where is the amount of commodity i routed from Si to ti. A generalization 

of this problem is the maximum weighted multicommodity flow problem in which additionally we 
are given weights wi, . . . ,Wk and we want to maximize the weighted sum of the flows Wi \fi\. 
Another popular variation of the multicommodity flow problem is the maximum concurrent flow 
problem. In this problem, we are given a set of k positive demands di, . . . ,dk and are asked to find 
a multicommodity fiow that is feasible (i.e. obeys arc capacities) and routes Xdi units of commodity 
i between each source-sink pair (sj,tj) - the goal is to maximize the value of A. If there is a cost 
function c : — ?> M"*" associated with arcs, where c(e) is the price of routing one unit of flow 
through arc e, the minimum cost concurrent flow problem is to find a maximum concurrent flow 
whose total cost i.e. the sum of the costs incurred by the flow on each arc, is within some target 
budget B. 
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Although all the problems defined above can be solved optimally in polynomial time by formulat- 
ing them as linear programs, in many applications it is more important to compute an approximate 
solution fast than to compute an optimal one. Therefore, much effort was put into obtaining ef- 
ficient fully polynomial-time approximation schemes (FPTAS) for multicommodity flow problems. 
A fully polynomial-time approximation scheme for a maximization problem is an algorithm that, 
given an instance of the problem and an accuracy parameter e > 0, computes, in time polynomial 
in the size of the input and 1/e, a solution that has objective value within a factor of (1 — e) of the 
optimal one. 

1.1 Previous work 

Over the past two decades there has been a rich history of results providing FPTASes for mul- 
ticommodity flow problems. Shahrokhi and Matula (SOj presented the first combinatorial fully 
polynomial-time approximation scheme for the maximum concurrent flow problem with uniform 
arc capacities, and introduced the idea of using an exponential length function to control arc con- 
gestion. Subsequently, a series of results [HJ Ell [HI [JSj [Ml [311 [251 [El [IS] based on Langrangian 
relaxation and linear programming decomposition yielded algorithms that had significantly im- 
proved running time and could be applied to various versions of the multicommodity flow problem 
with arbitrary arc capacities. All the above algorithms compute an initial (infeasible) flow and then 
redistribute it from more congested paths to less congested ones by repeatedly solving an oracle 
subproblem of either minimum cost single-commodity flow \21\ [T3l [T5l [25l \TE[ [T6] , or shortest path 
[301 [El [211 [31]. 

In [32], Young deviated from this theme by presenting an oblivious rounding algorithm that 
avoids rerouting of the flow. Instead, it builds the solution from scratch. At each step it employs 
shortest path computations (with respect to exponential length function that models the congestion 
of the arcs) to augment the flow along suitable (i.e. relatively uncongested) paths. At the end, 
it obtains the final feasible solution by scaling down the flow by the maximum congestion it in- 
curred on arcs. A similar approach was taken by Garg and Konemann [12]; however they managed 
to provide an elegant framework for solving multicommodity flow problems that yields a simple 
analysis of the correctness of the obtained algorithms. This allowed them to match and, in some 
cases, improve over the running time of the algorithms obtained via the redistribution methodology. 
Subsequently, Fleischer [11] used this framework to develop significantly faster algorithms for vari- 
ous multicommodity flow problems. In particular, for the maximum multicommodity flow problem 
she managed to obtain a running time of 0(m^e~^) (where O(-) notation hides poly-logarithmic 
factors) that is independent of the number of commodities. For the weighted version, she proposed 
an algorithm running in 0(?n^e~^ minjlog Af, /c}) time, where logM is the upper bound on the 
size of binary representation of every number used in the input instance. For the maximum (resp. 
minimum cost) concurrent flow problem her algorithm has a running time of 0{{m + k)me~'^) (resp. 
0{{m + k)me~'^ log M)) . Her results for both versions of the concurrent flow problem were later 
improved by Karakostas [1^, who was able to reduce the term in the running time that depends 
on k from 0{kme~'^) (resp. 0{kme~'^ log M)) to 0{kn£~'^). Interestingly, he also showed that if 
we want to obtain the (1 — e)-approximation of only the value of the maximum (resp. minimum 
cost) concurrent flow rate (without obtaining the actual flow) then this can be done in 0(m^e~^) 
(resp. 0(m^e~^ log M)) time. 

All the above algorithms have quadratic dependence of their running times on 1/e. Klein 
and Young [20] give evidence that this quadratic dependence is inherent for Dantzig-Wolfe-type 
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algorithmq^J — all the FPTASes mentioned so far are of this type. As it turns out, better dependence 
on 1/e can be obtained. Bienstock and Iyengar |6] adapted the technique of Nesterov [22] to 
give an FPTAS that has Ql giogi/g ) dependence on 1/e. Very recently, Nesterov j23j obtained an 
approximation scheme where this dependence is just linear. However, the running times of both 
these algorithms have worse dependence on parameters other than 1 je compared to the algorithms 
described above - for example, the approximation scheme due to Nesterov has the running time of 

1.2 Our contribution 

We build on the work of Garg and Konemann [l^ and Fleischer [Tl] to obtain faster approximation 
schemes for various versions of multicommodity flow problems. At a high level — when the size of 
every number used in the input instance (e.g. capacities, weights, and costs on arcs) is polynomially 
bounded — our improvements break the bottlenecking term of r2(m^e~^) that all the previous 
Dantzig- Wolfe-type algorithms suffer from, by substituting it with 0(mne~^) term. Our result is 
based on two main ideas. 

The first one stems from an observation that the shortest-path subproblems that algorithms 
following the Garg-Konemann framework solve repeatably are closely related. Namely, each suc- 
cessive subproblem corresponds to the same underlying graph - only the lengths of some of the arcs 
are increased. This suggests that treating each of these subproblems as an independent task ~ as it 
is the case in all the previous algorithms - is suboptimal. One might wonder, for example, whether 
it is possible to maintain a data structure that allows answering such a sequence of shortest-path 
queries more efficiently than just by computing everything from scratch in each iteration. Indeed, 
it turns out that this kind of questions were already studied extensively in the area of dynamic 
graph algorithms (see e.g. [I0l[3l[71[9l[26lil[8l[271[29l[28l[5]). In particular, the data structure that 
we would like to maintain corresponds to the decremental dynamic all-pair shortest path problem. 
Unfortunately, if we are interested in solutions whose overall running time is within our intended 
bounds, then it seems there is no suitable existing result that can be used (see section [3] for details). 

This lack of existing solution fitting our needs brings us to the second idea of the paper. We note 
that when we employ the Garg-Konemann framework to solve multicommodity flow problems, it is 
not necessary to compute the (approximately) shortest path for each shortest-path subproblem. All 
we really need is that the set of the suitable paths over which we are optimizing the length comes 
from a set that contains all the flowpaths of some fixed optimal solution to the multicommodity 
flow instance that we are solving. To exploit this fact, we introduce a random set of paths V (see 
Definition [5]) - that can be seen as a sparsification of the set of all paths in G, and that with high 
probability has the above-mentioned property. Next, we combine the ideas from dynamic graph 
algorithms to design an efficient data structure that maintains all-pair shortest path distances with 
respect to the set V. This data structure allows us to modify (in an almost generic manner) 
the existing algorithms for various multicommodity flow problems that are based on the Garg- 
Konemann framework and transform them into Monte-Carlo algorithms with improved running 
times. 

The summary of our results and their comparison with the previous ones can be found in 
Figure [TJ Note that there exist instances of concurrent flow problems (see Figure [2|) for which 

^ A Dantzig- Wolfe-type algorithm for a fractional packing problem - in which the goal is to find x in some polytope 
P that satisfies the set of packing inequalities Ax < 6 - is an algorithm that accesses P only by queries of the form: 
"given a vector c, what is the x £ P minimizing c ■ a;?". 
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Problem 


Previous best 


This paper 


maximum multicommodity flow 
maximum weighted multicommodity flow 
maximum concurrent flow 

minimum cost concurrent flow 


0(m2e-2 minjlog M, k}) [11] 
d{{m^ + kn)e-^) [iTj 
0(A;2m2e-i) [23] 
0((m2 log M + fcn)e-2) [17] 


0{mne~^) 
d{7rme'''^log'^ M) 
0((m + k)ne~'^ log M) 

0((m + A;)ne^2iQgjvf) 



Figure 1: Comparison of (1 — e)-approximation schemes for multicommodity flow problems. O(-) 
notation hides poly-logarithmic factors, m is the number of arcs, n is the number of vertices, k is 
the number of commodities, and log M is the upper bound on the size of binary representation of 
any number used in the input instance. 




Figure 2: By choosing any set of A; < n/16 distinct {si,tj) pairs as source-sink pairs for k commodi- 
ties and setting all demands to 1, we obtain an instance of the maximum concurrent flow problem 
for which any (1 — e)-approximate solution has representation size i}{kn) - each of n/2 — 1 arcs on 
the middle path has to have non-zero flow of all k commodities flowing through it. 



any (approximately) optimal solution has representation size of Q{kn). Therefore, in the setting 
where e is fixed or moderately small, say 1/log'^^^^n, and the size of every number used in the 
input instance is polynomially bounded, the corresponding 0{kn) term in the running time of our 
algorithms for concurrent flow problems is optimal (up to poly-logarithmic factors). Interestingly, 
in this setting, the running time of all our algorithms matches - up to poly-logarithmic factor 
and modulo the nearly-optimal 0{kn) term in case of concurrent flow problems - the rt[mn) 
flow- decomposition harrier for single- commodity flows. Recall that in the case of the maximum 
single-commodity flow problem Goldberg and Rao [H] presented an algorithm that improves upon 
this barrier. Thus we find the question whether one can also achieve a similar improvement for the 
maximum multicommodity flow problem very intriguingH 

^Note that the only obvious lower bound for the running time of an algorithm solving the maximum multicom- 
modity problem is r2(m + min{fc, n\n). This bound can be established by constructing instances as in Figure [J] where 
each of < n commodities corresponds to the source-sink pair {si,ti) for 1 < i < fc, all the arcs outgoing from SiS 
have capacity of 1, and the rest of the arcs have capacity of k. Clearly, any (approximately optimal) solution to such 
instances has representation size of Q,{mm{k, n}n). 
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1.3 Notations and Definitions 

Let G = {y,E,u) be a directed graph with capacities u : -E ^ M'^. In addition to capacities, we 
win often equip arcs of G with lengths given by some length function I : E —?■ . For any directed 
path p in G, by the length of p with respect to I we mean a quantity l(j>) := J2eep^i^)- ^'^^ 
two vertices u and v of G, a u-v path is a directed path in G that starts at u and ends at v. We 
define distance from u to v (with respect to I) for u,v & V to he the length (with respect to /) of 
the shortest u-v path. We will omit the reference to the length function / whenever it is clear from 
the context which length function we are using. 

For 1 < i < k, we denote by Vi the set of all Si-ti paths in G, where {{si,ti)}i is the set of 
k source-sink pairs of the instance of the multicommodity flow problem we are considering. Let 
V = IJ!Li -^or a given subset f/ C y of vertices, let V{U) be the set of all paths in V that pass 
through at least one vertex from U. Finally, for a given j > 0, let V{U,j) he the set of all the paths 
from V{U) that consist of at most j arcs. 

1.4 Outline of the paper 

We start with section [2] where we illustrate the Garg-Konemann framework [12] for the maximum 
multicommodity flow problem - we also outline the current best algorithm for this problem due to 
Fleischer [TT]. Next, in section [Sj we introduce the main ideas and tools behind our results - the 
connection between fast approximation schemes for multicommodity flow problems and dynamic 
graph algorithm for maintaining (approximatelj^ shortest paths with respect to the sparsified set of 
paths. In particular, we formally define the set "P, and the (5, Mmax; -^mim 7')-ADSP data structure 
that we will be using for maintenance of the (approximately) shortest paths that we are interested 
in. Subsequently, in section [U we show how these concepts lead to a more efficient algorithm for 
the maximum multicommodity flow problem, and then extend it to handle the weighted version 
of the problem. In section El we obtain an improved algorithm for the maximum concurrent flow 
problem and outline its generalization to the version with costs. We conclude in section [6] with an 
efficient implementation of the ((5, Mmaxi Afmim 7')-ADSP data structure. 

2 Garg-Konemann framework for solving multicommodity flow 
problems 

Our algorithms will follow the framework for solving multicommodity flow problems that was 
developed by Garg and Konemann [12] (see also [2] for a presentation of this framework from 
a slightly different perspective). For illustrative purposes, we now focus only on the variation 
of the framework for the maximum multicommodity flow - later, we will describe the variations 
corresponding to other types of multicommodity flow problems. 

The starting point of this framework is the following path-based linear programming formulation 
of the maximum multicommodity problem: 
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max 

s.t. ^fp< u{e) Ve G E, (1) 

/p > V^J € p. 

Here /p represents the flow on path p G and we recall that V is the set of all Sj-tj paths in G, 
where {(sj,ti)}i is the set of k source-sink pairs of the instance of the maximum multicommodity 
flow problem we are considering. The dual of this linear program corresponds to assigning lengths 
/(•) to the arcs in such a way that length of every path in V is at least one and the total volume of 
the network i.e. X^eg^; ^(e)n(e) is minimized. 



min /(e)u(e) 

e&E 

S.t. ^/(e) > 1 VpGP, (2) 

eGp 

l{e) > Ve G 

Intuitively, the total volume is an upper bound on the value of the maximum multicommodity 
flow, since when lengths /(•) constitute a feasible dual solution, routing one unit of flow between 
any source-sink pair uses up a volume of at least one. 



Input : Graph G = {V,E), capacities u(e), commodity pairs {{si,ti)}i, accuracy parameter e > 
Output: (Infeasible) flow / 

Initialize / ^ 0, and /(e) <— 7 for all arcs e e E, where 7 = (1 + £)/((! + £)n)^/^ 
while there is a path p E P with l{p) < 1 do 

Select path p that is the shortest one (with respect to I) in P 

Find the bottleneck capacity u of p {* u ■(— niinegpu(e) *) 

Augment the flow / by routing u units of flow along the path p 
foreach arc e in p do l{e) <— /(e)(l + :;^) 
end 

return / 

Figure 3: Garg-Konemann algorithm for finding maximum multicommodity flow 



To find a (1 — e)-approximate solution to the above linear program ([T]) and thus to obtain 
corresponding multicommodity flow, Garg and Konemann employ an algorithm presented in Figure 
[31 The algorithm maintains flow /, and a length function I. Initially, / = 0, and / = 7 i.e. there is 
no flow routed, and the length of each arc is 7, where 7 = (1 + e)/((l +e)n)^/^ is very small. Now, 
as long as there are paths in V having length smaller than one, the algorithm chooses the shortest 
path p among these paths and augments the flow / along it. The amount of flow routed over p is 
equal to the bottleneck capacity u oip i.e. u is the minimal capacity among all the capacities of the 
arcs oip. After augmenting the flow, we update the length function by multiplying the length 1(e) 
of each arc e of p by a factor of (1 + -j^)- 
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It is not hard to see that the final flow / produced by the above procedure may violate some of 
the arc capacities. Therefore, to obtain a feasible solution we need to scale the final flow / down 
by the maximum congestion / incurred on arcs. Since we only augment the flow along paths with 
length smaller than one and our length update rule ensures that the length of arcs is exponential 
in their congestion, we can conclude that this maximum congestion is not very large. 

Lemma 1 (see [E]). The flow obtained by scaling the final flow f down by log]^_|„£ is feasible. 

Moreover, the fact that we always augment the flow along the shortest path in "P - which 
intuitively means that we aim at routing the flow through arcs that are relatively uncongested - 
allowed Garg and Konemann to bound the quality of the obtained solution. 

Lemma 2 (see [12]). /// is the final flow computed then ^-^^ ^ — 2e)OPT, where OPT is 
the value of the optimal flow. 



The key ingredient in the proof of the above lemma is an observation ~ a simple consequence of 
weak duality between linear programs ([T]) and ([2]) - that for any length function I there is always 
a path p in V whose length with respect to / is at most 1 /OPT fraction of the total volume of the 

graph G i.e. lip) < ^^§0^. 

Now, to analyze the running time of the algorithm, we note that in each augmentation the 
length of the arc with bottleneck capacity increases by a factor of (1 + e). Since no arc achieves 
a length bigger than (1 + e), there can be at most m[log^^_g ^i^J = 0{me~'^) augmentations of 
the flow. To perform each such augmentation we have to find the shortest path in V, this can be 
done in 0{km) time by running Dijkstra's algorithm from each possible source. This establishes 
the following theorem. 

Theorem 3 (see [E]). For any e > one can compute (1 — 2£)- approximation to maximum 
multicommodity flow problem in time 0{kvn?e~'^). 

Subsequently, Fleischer [11] presented a more efficient version of the above algorithm. Her 
improvement is based on the realization that whenever we need the shortest path in the Garg- 
Konemann algorithm, it is sufficient to compute an (1 + e)- approximately shortest path. This 
allows for modification of the algorithm of Garg and Konemann to avoid solving the shortest- 
path problem for all the source-sink pairs each time the flow is augmented. Instead, we cycle 
through all commodities, keeping augmenting the flow along the shortest path corresponding to 
given commodity as long as the length of this path is at most (1 -|- e)3 - where a is a lower 
bound estimate of the current length of the shortest path in V maintained by the algorithm - 
and moving on once it does not. To start, we set 3 = 7 and we do not increase its value as long 
as we manage to augment the flow along some path in V of small enough length (i.e. at most 
(1 + e)a). Once we are unable to find such a path i.e. our cycling through commodities made 
a full cycle, we set q ^ (1 + e)a, and start cycling again unless a is already bigger than one - 
in which case we scale the obtained flow down to make it feasible and the algorithm terminates. 
The algorithm is presented in Figured! An important implementation detail is that when cycling 
through commodities, we group together source-sink pairs that share the same source. This allows 
us to take advantage of the fact that one execution of Dijkstra's algorithm computes simultaneously 
the shortest paths for all these pairs. To see why the above modifications reduce the number of 
shortest path computations needed, notice that each execution of Dijkstra's algorithm either results 
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in flow augmentation, or causes us to move on in our cycling to the next group of commodities that 
was not yet examined. Note that our way of updating the value of a ensures that there is at most 
[log(]^_i_£-) = 0(logme~^) full cycles through commodities. Also, the number of flow augmentation 

is still at most m[log;^^£ ii^J = 0(me~^). Therefore, we have at most 0((m + minj/c, n})e~^) 

executions of Dijkstra's algorithm - instead of 0{kme~'^) executions in the original algorithm due 
to Garg and Konemann. Fleischer proves the following theorem. 

Theorem 4 (see jllj). For any 0.15 > e > the algorithm in Figure\^ runs in time 0(m^e~^), 
and returns a flow that has value at least (1 — Ae)OPT . 



Input : Graph G — {V,E), capacities u(e), commodity pairs {(si,ti)}i, accuracy parameter e > 
Output: Flow / 

Initialize / ^ 0, S 4- 7, and /(e) ^ 7 for all arcs e 6 E, where 7 = (1 + e)/((l + e)n)^/'^ 

I{s) {i I Si = s} for each s Cz V (* grouping source-sink pairs with common sources *) 

while a < 1 do 

foreach s G V with /(,s) 7^ do (* cycling through commodities *) 

Use Dijkstra's algorithm to find the shortest (with respect to /) path p in Uie/(s) T^i 
while l{p) < (1 + e)a do 

Find the bottleneck capacity ii of p (* w <— minggp u(e) *) 

Augment the flow / by routing u units of flow along the path p 

foreach arc e in p do /(e) ^ /(e)(l + ^^) 

Use Dijkstra's algorithm to find the shortest (with respect to /) path p in lJie/(s) 

end 
end 

a <— {I + e)a (* increase the value of a *) 

end 

Scale / down by a factor of maxceB /(e)/u(e) and return it 

Figure 4: Fleischer's algorithm for solving maximum multicommodity flow 



3 Solving multicommodity flow problems and dynamic graph al- 
gorithms 

As described in the previous section, the approximation scheme for the maximum multicommodity 
flow problem due to Garg and Konemann [12] flnds a near-optimal solution by repeatedly solving the 
oracle subproblem of computing the shortest path in graph G with respect to some evolving length 
function /. (Later we will see that the same general approach is also used for the other variants of 
multicommodity flow problems.) As a consequence, the running time of the resulting approximation 
schemes is dominated by the time needed to solve these subproblems using Dijkstra's algorithm. 
By careful choice of the subproblems as well as better utilization of the computed answers, the 
number of these (single-source) shortest path computations was reduced considerably in subsequent 
improvements due to Fleischer [11] and Karakostas [17]. However, the reduced numbers are still 
r2(me~^) which leads to a time complexity of r2(m^e~^) for the corresponding algorithms. 
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The main observation behind the construction of our improved approximation schemes is that 
treating each of the oracle subproblems as an independent task (and thus using Dijkstra's algorithm 
each time), as the above-mentioned results do, is suboptimal. After all, each successive subproblem 
corresponds to the same underlying graph - only with lengths of some of the arcs increased. There- 
fore, one might hope to construct a data structure that solves such a sequence of subproblems more 
efficiently than by computing each time everything from scratch. More precisely, one might wonder 
whether there is an efficient data structure that maintains a directed graph G with lengths on 
arcs and supports operations of: increasing a length of some arc; answering shortest-path distance 
query; and returning shortest vertex-to-vertex path. 

It turns out that the problem of designing such a data structure is already known in the literature 
as the decremental dynamic all-pairs shortest path problem and extensive work have been done on 
this and related problems (see e.g. [IHlEllZlElIMlllEllSZlllSllSHllS]). However, if we are interested in 
solutions whose overall running time is within our intended bounds, the result that is closest to what 
we need is the one by Roditty and Zwick [27]. They show if G were undirected and had positive, 
integer lengths on edges, with maximum length being b, a (1 + (^)-approximate solution to the 
decremental dynamic all-pair shortest path problem can be implemented with total maintenance 
time of O(^), 0(1) time needed to answer any vertex-to-vertex shortest-path distance query, 
and returning shortest vertex-to-vertex path in 0{n) timeU Unfortunately, in our applications the 
graph G is not only directed, but also the lengths of the arcs (when we scale them to make them 
integral) can be of order of 6 = r2(n^/^) with e < 0.15. Therefore, the resulting running time 
would be prohibitive. Further, the construction of Roditty and Zwick assumes that the sequence of 
operations to be handled is oblivious to the behavior of the data structure (e.g. to its randomized 
choices). This feature is a shortcoming from our point of view since in our setting the way the 
length function of the graph evolves depends directly on which shortest paths the data structure 
chose to output previously. 

To circumvent this lack of suitable existing solutions, we realize that for our purposes it is 
sufficient to solve a simpler task than the decremental dynamic all-pairs shortest path problem in 
its full generality (i.e. in the directed setting, and allowing large lengths on arcs and adversarial 
requests). Namely, when we are using the Garg-Konemann framework to solve multicommodity 
flow problems, it is not necessary to compute for each subproblem the (approximately) shortest path 
among all the suitable paths in the set V. As we will prove later, to establish satisfactory bounds 
on the quality of the final flow, it suffices that whenever we solve some shortest-path subproblem, 
the set of suitable paths over which we are optimizing the length comes from a set that contains all 
the flowpaths of some fixed optimal solution to the instance of the multicommodity flow problem 
that we are solving. 

With this goal in mind, we define the following random subset V of paths in One may view 

V as a sparsification of the set V. 

Definition 5. For j = 1, . . . , [logn], let Sj be a random set obtained by sampling each vertex of 

V with probability pj = min{i^, 1}. Define V := [jflT^ 'P{Sj,2^), where V{U,i') for a given 
U Q V , and j' > is the set of all paths in V that consist of at most f arcs and pass through at 
least one vertex ofU. 

^Note that there can be as many as mb edge length increases in a sequence, thus this solution is faster than naive 
solution that just computes all-pairs shortest-path after each edge-length increase, or one that just answers each of 
the queries using Dijkstra's algorithm. 

*It is worth noting that a very similar set was used in [27] albeit with a slightly different motivation. 
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It turns out that this sparsification V retains, with high probabihty, the key property that we 
need. 

Lemma 6. For any fixed multicommodity flow f = (/i, . . . , f/.) solution, with high probability, all 
the flowpaths of f are contained in V. 

Proof: Let pi, . . .pg be the decomposition of the flow / into flowpaths. By definition, all pi are 
contained in the set V. Furthermore, by standard How decomposition argument we know that 
q < km < n^. Let us focus now on some particular path pi. Let 1 < t < n be the number of arcs in 
this path, and let j* be the smallest j for which t < 2^ . The probability that pi € V{Sj*, 2^*) C P 
is exactly the probability that at least one vertex from p is in Sj* . Simple computation shows that 
the probability that none among t + 1 vertices of pi is in V{Sj*, 2^ ) is at most 

^21 - 

Therefore, by union bounding over all q < paths pi, we get that indeed {pi, . . . ,pq} C P 
with high probability. I 

3.1 {S, Minax, M^in, Q)-ADSP data structure 

Once we defined set V, our goal is to devise an efficient way of maintaining the (1 + (5)-approximate 
shortest paths with respect to it. We start by formally defining our task. 

Definition 7. For any S >0, Mmax > 2Mram > and a set of paths Q C "P, let the (^-approximate 
decremental (Mmaxi -^mim Q)-shortest path problem ({6, M^i^^, M^i^, Q)-ADSP, for short) be a 
problem in which one maintains a directed graph G with a length function I on its arcs that supports 
four operations (sometimes we will refer to these operations as requests^; 

• Distance{u,v, f3), for u,v (zV, and /3 S [Mmin, Mmax/2] let d* be the length of the shortest 
(with respect to I) u-v path in Q; if d* < 2(3 then the query returns a value d such that 
d < d* + 5/3. If d* > 2/3, the query may return either d as above, or oo; 

• lncrease{e,uj), for e (z E and lo > Q: increases the length l{e) of the arc e by uj; 

• Path{u,v, (3) , for u,v G V, and (3 € [Mmm, -Wjnax/2].' returns a u-v path of length at most 
Distance{u,v, /3), as long as Distance{u,v, 13) ^ oo; 

• SSrcDist{u, (3) foru G V, and (3 G [Mmin, Mmax/2] •■ returns Distance{u,v, f3) for all v ^V. 

Intuitively, /3 is our guess on the interval [f3, 2(3] in which the length of the shortest path we are 
interested in is. We say that (3 is (u, v)-accurate for given (5, Mmax, M^mm-, Q)-ADSP data structure 
R and u,v , if the length d* of the shortest u-v path in Q is at least (3 and the data structure 
R returns a finite value in response to Distance(M, f , /3) query. Note that if f3 is (n, z;)-accurate 
then the 5/3-additive error guarantee on the distance estimation supplied by R in response to 
Distance(ii, V, /3) query implies a (1 + 5) multiplicative error guarantee. Also, as long as d* is at 
least Mjnin (this will be always the case in our applications), we can employ binary search to ask 
0(log log Mmax/Mmin) Distance(n, f , •) queries and either realize that d* is bigger than Mmax, or 
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find < i < [log Mmax/2Mminl such that /3j = min{2*Afmm, Afmax/2} is (u, f )-accurateJl Finally, 
it is worth emphasizing that we do not require that the paths returned in response to Path(-, •, •) 
queries are from Q - all we insist on is just that all the suitable paths from Q are considered when 
the path to be returned is chosen. 

In section [6l we describe how the ideas and tools from dynamic graph algorithms lead to an 
implementation of the (c^, Mmaxj -^mim ^)-ADSP data structure that is tailored to maintain the 
shortest paths from set V and whose performance is described in the following theorem. The 
theorem is proved in section 16.21 

Theorem 8. For any 1 > 6 > 0, M^ax > 2Mmin > 0, (5, Mmax, Mmin, :P)-^DS'P data structure 
can be maintained in total expected time O [mn ^^max/^'/mm ^ ^^^^ additional 0(1) per Increase^-, •) 
request in the processed sequence. Each Distance{-,-,-) and Path{-,-,-) query can be answered in 
0{n) time, and each SSrcDist{-, ■) query in 0{m) time. 

3.2 Solving the decremental dynamic all-pair shortest paths problem using the 

((^i Mjnax,^min,'^)-ADSP data structure 

Interestingly, we can use the (5, Mmax, -^mirn 'P)-ADSP data structure construction from Theorem 
E]to obtain a (1 + e)-approximate solution to the oblivious decremental dynamic all-pair shortest 
path problem in directed graphs with rational arc lengths, where obliviousness means that the 
sequence of requests that we process does not depend on the randomness used in the solution. 

Theorem 9. For any 1 > e > 0, and L > 1 there exists a (l + e)- approximate Monte Carlo solution 
to the oblivious decremental dynamic all-pair shortest paths problem on directed graphs where arc 
lengths are rational numbers between 1 and L, that has total maintenance cost of 0{mn^^^^) plus 
additional 0(1) per increase of the length of any arc, and answers shortest path queries for any 
vertex pair in 0(n(log log(i^£-) L) (log log L)) time. 

Note that even when we allow lengths to be quite large (e.g. polynomial in n), the maintenance 
cost of our solution is still similar to the one that Roditty and Zwick achieved in [27] for undirected 
graphs with small integer lengths. Unfortunately, our distance query time is 0(n) instead of the 
0(1) time obtained in [27]. So, the gain that we get over a naive solution for the problem is that we 
are able to answer ((1 + e)-approximately) shortest path queries for any vertex pair in 0(n) time, 
as opposed to the 0(m + nlogn) time required by Dijkstra's algorithm. The proof of the theorem 
can be found in Appendix lAl 

4 Maximum multicommodity flow 

We proceed to develop a faster algorithm for the maximum multicommodity flow problem - later 
we will generalize it to solve the weighted version of the problem. As we indicated in the previous 
section, the basic idea behind our improvement is modification of Fleischer's algorithm (presented 
in Figure U]) to make it exploit the dependencies between the oracle subproblems. More precisely, 
instead of employing Dijkstra's algorithm each time, we answer the shortest-path questions by 

^The binary search just chooses i in the middle of the current range of values in which the desired value of i may 
lie (initially this range is [0, [log Afmax/2Afmin]]), and if the Distance(it, i), query returns oo then the left half of 
the range (including the i queried) is dropped, otherwise the other half is dropped. 
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querying a (5, Afmaxi -^mim 'P)-ADSP data structure (as described in Theorem[8]) that we maintain 
for appropriate choice of 5, Mmax; aud Mmin, and where 7-" is a sparsification of V, as described in 
Definition^ However, the straight-forward implementation of this idea encounters some difficulties. 

First, we have to justify the fact that while answering shortest-path queries we take into account 
mainly paths in V, as opposed to the whole set V. Second, an important feature of Dijkstra's 
algorithm that is exploited in Fleischer's approximation scheme, is the fact that whenever one 
computes the distance between a pair of vertices using this algorithm it simultaneously computes 
all single source shortest-path distances. Unfortunately, in our case we cannot afford to replicate 
this approach; thus we need to circumvent this issue in a more careful manner. We address these 
problems below. 

4.1 Existence of short paths in V 

As mentioned in section [21 the key ingredient used in the Garg-Konemann framework to bound 
the quality of the solution for the maximum multicommodity fiow problem is the fact that for any 
length function / of G there is always a path pinV with length l{p) being at most l{e)u{e)/OPT. 
We prove now that with high probability the same property still holds when we consider only paths 
in V. 

Lemma 10. With high probability, for any length function I, there exists a path p ^ V with 
l{p) < ^"qp^^^^ , where OPT is the optimal value of the maximum multicommodity flow. 

Proof: Let /* = {fl, /|, . . . , /^) be some optimal multicommodity fiow with |/*| = OPT. By 
Lemma [6] we know that with high probability V contains all the flowpaths pi, . . . ,pq of /*. The 
fact that /* has to obey the capacity constraints implies that l{e)u{e) > Yl'j=i KPj)f*{Pj)- But 
OPT = Ylii \fi \ = Sj=i/*(Pi); averaging argument shows that there exists a j* such that 
KPj* ) < Ee Ke)u{e)/OPT as desired. I 
To get a slightly different perspective on the above statement, note that the only property of 
V we are using in the proof is that it contains (with high probability) all the flowpaths of some 
optimal solution. This means that if we consider a restriction LP' of the linear program ([1]) in 
which we set to zero all the variables fp with p G V\V, then with high probability the optimum of 
this restricted linear program LP' is still equal to the original optimum i.e. OPT. Therefore, one 
may view the statement of the above lemma as a simple consequence of the weak duality between 
LP' and its dual linear program. 

4.2 Randomized cycling through commodities 

For a given value of 3, and some ((^, Mmaxi -^mim 'P)-ADSP data structure i?, we say that a source- 
sink pair (s,f) is admissible for a (with respect to R) if upon querying R with Distance(s, t, S) the 
obtained answer is at most (1 + 25)a. In other words, {s,t) is admissible for a if i2's estimate of 
the distance from s to t in "P is small enough that our algorithm could choose to augment the fiow 
along this path - provided a was its current lower-bound estimate of the length of the shortest path 
in V. Obviously, our algorithm is vitally interested in finding source-sink pairs that are admissible 
for its current value of S - these pairs are the ones that allow augmentation of the fiow. 

Unfortunately, given the set of all possible pairs {(si, ti ),..., (s^, t^)}, and the data structure R, 
it is not clear at all which one among them (if any) are admissible for given a. Note, however, that 
if we deem some source-sink pair (s,t) inadmissible for a (by querying R for the corresponding s-t 
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distance) then, since our length function is always increasing, this pair will never become admissible 
for a again. This suggests the following natural approach for identification of admissible pairs for a 
given a. We cycle through all the sink-source pairs and query R for the corresponding distance, we 
stick with one pair as long as it is admissible, and move on once it becomes inadmissible. Clearly, 
the moment we cycled through all pairs, we know that all the pairs are inadmissible for a with 
respect to the current length function I. The problem with this approach is that the resulting 
number of s-t distance queries is at least k and thus this would lead to the somewhat prohibitive 
bottleneck of Q,{kn) in the running time (note that k can be il(n^)). 

To alleviate this problem we note that a very similar issue arose in Fleischer's algorithm - 
she avoided the above bottleneck by grouping the source-sink pairs according to common sources 
and exploiting the fact that Dijkstra's algorithm computes all single source shortest-path distances 
simultaneously. Therefore, one execution of Dijkstra's algorithm either finds an (analog of) admis- 
sible pair, or deems all the pairs sharing the same source inadmissible. Unfortunately, although our 
(5, Mmax, -^min, 'P)-ADSP data structure allows single source shortest-path distance queries, these 
queries require 0{m) time and we cannot afford to use them to obtain s-t distances in the manner 
Fleischer did - this could cause Q(m?e~'^) worst-case running time. We therefore devise a different 
method of circumventing the bottleneck. To describe it, let us assume that we are given some 
vertex s, and a set /(s) of source-sink pairs that have s as their common source and that have not 
yet been deemed inadmissible for our current value of a. Our procedure samples [log n] source-sink 
pairs from I{s) and checks whether any of them is admissible using the Distance(-, •, •) query. If so, 
then we return the admissible pair found. Otherwise, i.e. if none of them was admissible, we use 
the SSrcDist(-, •) query to check which (if any) source-sink pairs in I{s) are inadmissible, remove 
them from the set I{s) and return an admissible pair (if any was found). We repeat the whole 
procedure - if I{s) became empty, we proceed to the next possible source s - until we examine all 
source-sink pairs. The algorithm is summarized in Figure [6] - for convenience, we substituted for 
S, Mmax, and Mmin the actual values used in our algorithm. The intuition behind this procedure 
is that if all [logn] samples from I{s) turned out to be inadmissible then with probability at least 
(1 — ^), at least half of the pairs in I(s) is inadmissible, and therefore the SSrcDist(-, •) query will 
reduce the size of I{s) by at least half. Therefore, as we will show later, the expected number of 
SSrcDist(-, •) queries is not too large. 

4.3 Our algorithm 

We present our algorithm for the maximum multicommodity flow problem in Figure [5j As we 
already noted, the basic idea behind it is making Fleischer's algorithm (presented in Figure U]) to 
answer distance queries using an (e/2, 1,7,'P)-ADSP data structure (where V is constructed as in 
Definition [5]) . To implement this idea efficiently, we incorporated the randomized cycling through 
commodities described above. 

We prove first that the flow produced by our algorithm is indeed close to the optimal one. 

Lemma 11. For any 0.15 > e > 0, with high probability, the algorithm presented in Figure\^ finds 
an (1 — 3e)- approximate solution to the maximum multicommodity flow problem. 

Proof: Let Ij be the length function / after j-th augmentation of flow /, and let a{j) be the length 
of the shortest path in V with respect to Ij. Also, let gj be the total value of fiow routed after 
j-th augmentation. Finally, let OPT be the value of the optimal solution to our instance of the 
maximum multicommodity flow problem. 
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Input : Graph G = {V,E), capacities u{e), commodity pairs {{si,ti)}i, accuracy parameter e > 
Output: Flow / 

Initialize / 0, S 7, and ^(e) ^ 7 for all arcs e e E, where 7 = (1 + e)/((l + £)ri)^/^, and 
e ^ e{l + e) 

Sample sets {S'j}j=i,...,[iogn] to indicate the set V (see Definition [5]) 
Initialize (e/2, 1, 7, 'P)-ADSP data structure R as in Theorem [8] 
while a < 1 do 

-^i^) ^ {* I *j = '^l each s € V (* initializing pairs to be examined *) 

foreach s ^ V with I{s) ^ do (* cycling through commodities *) 

((s,t),/(.s)) ^ Find_Admissible_Pair(e,ii!, a,/(s)) 

while l{v) 7^ do 
p i?,.Path(s,t, S) 

Find the bottleneck capacity u of p (* w <— minegp M(e) *) 

Augment the flow / by routing u units of flow along the path p 

foreach arc e in p do i?.lncrease(e, ^^7^^); '(e) <— '(e)(l + -^^^ 
{{s,t),I{s)) Find_Admissible_Pair(£, i?, a, /(s)) 

end 
end 

a^{l+e/2)a (* increase the value of a *) 

end 

Scale / down by a factor of maxege /(e)/u(e) and return it 

Figure 5: Improved algorithm for solving maximum multicommodity flow. Find_Admissible_Pair 
procedure is described in Figure El 



Input : Accuracy parameter e > 0, {e/2, 1,7, 7^)-ADSP data structure R, lower bound a on 
min^^j^ and a set I{s) of source-sink pairs that might be admissible for a 

Output: ((s, t), I'{s)), where I'{s) is a subset of /(s), and (s, t) is: an admissible pair for a if 
I'{s) ^ 0; an arbitrary pair otherwise 

for i = 1 , . . . , [log n\ do 

Sample a random source-sink pair (s,t) from /(s) 

if R.Distance{s,t,a) < (l-l-e)Sthen (* checking admissibility for a *) 

I return ((.s, i), /(.s)) 
end 
end 

(* No admissible pairs sampled *) 
Use i?.SSrcDist(s, S) to check admissibility for a of all the source-sink pairs in I{s) 
Let I'{s) be the subset of admissible pairs from I{s) 
if /'(s) ^ then 

I return ((.s, i), /'(s)) where {s,t) e I'{s) 
else 

I return {{s,t),$) where {s,t) is an arbitrary pair 
end 

Figure 6: Procedure Find_Admissible_Pair 
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We start by proving that for every j, the value Sj of a immediately before {j + l)-th augmen- 
tation is at most a{j). To prove this, assume for the sake of contradiction that this is not the 
case; let j* be some j for which aj > a(j). This means that there exists a s-t path p € V with 
lj*{p) < Oj*- Since lj*{p) > 7, it must have been the case that aj* > 7 and the pair {s,t) was 
deemed inadmissible for some earlier point of the algorithm - otherwise the value of a 

would never increase up to aj*. But this is impossible, since the length of p could only increase 
over time and 

h'(p) + oT; — < «i* + o7i — = (1 + e)- 



2(l + e/2) ' 2(l + e/2) ' '{l + e/2)' 

Thus Distance(s, t, aj* /(I + e/2)) must have had return a value of at most (1 + e) (i°g/2) ^^i^h 
would deem the pair {s,t) admissible. 

Let us define D{j) := X^ees *° volume of G with respect to Ij. For any j >1 

we have that lj-i{pj) < (1 + e)Sj_i < (1 + e)a(j — 1), and therefore 

DU) = J^/j-i(e)n(e) + e ^ /j-i(e)(5j - < ^(j - 1) + Oa{j - l){gj - ^j-i), 

where = e(l + e). This in turn implies that 

j 

D{j) < D{0) + e^igy - gy.i)aij' - 1) (3) 
j'=i 

By applying Lemma [TOl to the length function Ij — Iq, we get that with high probability, for 
every j > 1 

OPT < (4) 

a(j) - 7n 

where we used the fact that loip) < 7?^ for any path p. Substituting ([3]) in equation ([H) gives 



< 7n + — ^ ^idj' - 9j'~i)oL{j - 1). 



Now, if we focus on a particular j', the right hand side is maximized by setting all a(j') to their 
maximum possible values for all < j' < j. Let a'{j) be such a maximum value for any j. Thus 
we have 

a{j) < a'{j) = a'U - 1)(1 + < a'(j - l)e^fe-^-^)/0^^ 

Since q'(0) = 772, this implies that a(j) < 7716^^-"''^^^, and since we stop augmentations once 
> 3 is at least 1, we know that after the final, say j/-th, augmentation, we have 

1 < a{jf) < 7ne^^'*/o^^ 

and thus 
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^ < ^ (5) 
9jf ln(7n) ^ 

Since no arc can have length /(e) larger than + throughout the algorithm, and routing n(e) 
units of flow through e causes increase in /(e) by a factor of at least (1 + e), the factor by which we 
have to scale down the flow / at the end is at most [log;^^^ . Therefore, by substituting the 
bound from (l5|), we see that the final value of flow / is at least 

Setting 7 = (1 + e)((l + e)n)^^^^ and using the definition of 9, we have 

\f\>ii^^^-l)Hl + e))OPT. 
This quantity is at least (1 — 3e)OPT thereby concluding the proof. 

I 

We are ready to establish the following theorem. 

Theorem 12. For any 0.15 > e > 0, with high probability, the algorithm presented in Figure\^ 
finds a (1 — 3e)- approximate solution to the maximum multicommodity flow problem in expected 
0{mne~'^) time. 

Proof: The fact that with high probability the final flow is a (1 — 3e)-approximation to the optimal 
flow follows from Lemma [TTJ 

To bound the running time of the algorithm, we note that it is dominated by the total cost of 
maintaining our (e/2, 1,7,'P)-ADSP data structure R, and servicing all the requests issued to it - 
all other operations performed by the algorithm can be amortized within this total cost. 

By Theoremdl the total expected maintenance cost of our data structure R is at most 0{mn ^"^y"' ) 
0{mne~'^). Also, note that each augmentation of the flow results in at least one (bottlenecking) 
arc having its length increased by a factor of (1 + e), and during the algorithm no arc e can 
have its length bigger than (1 + e). Therefore, there can be at most "^UoS(i+£) ^~^~^J ^^o'^ aug- 
mentations. As a result, the cost of serving all Path(-,-,-) and lncrease(-, •) requests is at most 
m[log(;^^£-) '^^-^\{0{n) + n ■ 0(1)) = 0{mn£~'^), as desired. 

Now, to bound the time needed to service all the Distance(-, •, •) queries, we note that there 
can be at most m[log(^i^^^ ^~^J samplings of source-sink pairs in the Find_Admissible-Pair 
procedure that yield an admissible pair. This is so, since finding an admissible pair results in 
flow augmentation. Thus the total cost of samplings that found some admissible pair is at most 
[log n] m [log(;^ _,_£■) ^^^^JO(n) = 0(mne~^). On the other hand, in cases when sampling does not 
yield an admissible path the time needed to serve all the corresponding Distance(-, •, •) queries can 
be amortized in the time needed to serve SSrcDist(-, •) that is always issued afterward. 

Therefore, all that is left to do is to bound the expected service cost of SSrcDist(-, •) queries. We 
call a SSrcDist(s, a) successful if it resulted in decreasing the size of I{s) by at least a half. Note 
that there can be at most [logn] successful SSrcDist(-, •) queries per one source and one value of a. 
As a result, the total time spent on answering successful queries is at most Llog(i+e/2) ^J^ ' 0{m) = 
0{mne~'^), since we have at most [log(i_|_£/2) different values of a. On the other hand, to 
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bound the time taken by serving unsuccessful SSrcDist(-, •) queries, we notice that each (successful 
or not) SSrcDist(-, •) query either empties one set I{s) for given source s and a value of a, or 
finds an admissible pair (which results in flow augmentation), therefore there can be at most 
(n[log(i_,_£/2) + ^iT- Uog{i+e) ^^^^J) SSrcDist(-, •) queries in total. Moreover, the probability that a 
particular query is unsuccessful is at most ^ - this follows from the fact that if I{s) has more than 
a half of pairs admissible for given a then the probability that none among [logn] independent 
samples turns out to be admissible is at most (i)ri°g"l < 1. Therefore, the total expected cost 
of this type of queries is at most ("Liog(x+./2) ^J+rnLiog(,^,) ^i) ^ ^ d{mne-^), as 

desired. The theorem follows. 

I 

4.4 Extension to weighted maximum multicommodity flow 

Recall that the weighted maximum multicommodity flow problem is a generalization of the maxi- 
mum multicommodity problem in which each commodity i has a positive weight Wi associated with 
it and we want to find a solution / = (/i, . . . , fk) that maximizes By scaling, we may 

ensure that the minimum weight is one, and maximum weight has some value W. In Appendix IbI 
we present a simple modification of our algorithm for the maximum multicommodity flow problem 
that can solve this generalization. We prove there the following statement. 

Corollary 13. For any 0.15 > e > 0, there exists a Monte Carlo algorithm that finds a (1 — 3e)- 
approximate solution to weighted maximum multicommodity flow problem in expected 0{mne~'^ log^ W) 
time. 

5 Maximum concurrent flow 

In the maximum concurrent flow problem, in addition to graph G = {V, E) with capacities n(-) (we 
assume that mineti(e) = 1, and let U := maxeti(e)), and k source-sink pairs {si,ti), we also have 
a demand di > associated with each commodity i. The task is to find a feasible multicommodity 
flow routing \di units of each commodity i for maximum A. 

Let A* be the optimal maximum concurrent flow ratio. When A* is at least one, Garg and 
Konemann [12] describe an approximation scheme that runs in 0((m + k)me~'^) time - we will 
describe this algorithm shortly. To handle the cases when A* is less than one, they describe a 
procedure to scale the demands so that it becomes at least one. This procedure computes, for each 
source-sink pair {si,ti) the value rji of maximum Si-ti flow. Let rj* = minjr^j/dj. Clearly, A* < if. 
Also, the fact that we can simultaneously route 1/k fraction of each of these k maximum flows 
implies that A* > ri*/k. Therefore, scaling all the demands by r]* /k ensures that 1 < A* < A;, and 
thus the approach for the case of A* > 1 can be applied. Subsequently, Fleischer [TT] presented 
a different scaling procedure - based on maximum bottleneck path computations - that allows 
obtaining a ?n-approximation of A* in time 0{m.m{n,k}m). This change made the preprocessing 
needed to ensure that A* > 1 no longer dominate the running time of the whole algorithm, thus 
the total running time of 0((m + k)me~'^) has been obtained. In [T7] Karakostas further improved 
the running time of this algorithm by making it run in 0{{m? + kn)e~'^) time. 

We proceed to a more detailed description of the algorithm of jl2j for the case of 1 < A* < m - 
as we already said, the scaling procedure from [11] justifies this assumption. We start with a zero 
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flow - / = 0, and each arc e has initially length Z(e) = where 7 = (^^)~^^^- The algorithm 
proceeds in phases - each one of them consists of k iterations. In iteration i, the algorithm tries to 
route di units of flow from Sj to ti. This is done by repeating the following steps. First, a shortest 
(with respect to current length function /) Sj-tj path p is found. Next, we compute the bottleneck 
capacity u, which is the minimum of the bottleneck capacity of the path p and the remaining 
demand di to be routed. We augment the flow by routing u units of it along the path p. Finally, 
we increase the length of each arc e of the path p by a factor of (1 + and decrease di by u. 

The entire procedure stops when D(l) := ^f.l{e)u{e) - the volume of G with respect to I, is at 
least one. The summary of the algorithm can be found in Figure [71 



Input 


Graph G = {V,E), capacities u{e), commodity pairs {{si,ti)}i with demands di > 0, 








accuracy parameter e > 


Output: 


(Infeasible) flow / 


Initialize / ^ 0, ^(e) ^ for all arcs eE E. where 7 = {j^)'^^" 


while D{1) < 1 do 




for i 


:= 1, . . . ,k do 






dt di 






while D{1) < 1 and > do 








Find the shortest path p in Vi 








Find the bottleneck capacity u of p (* u ^ iiiin{di, miiiegp u(e)} *) 








di <^ di — u 








Augment the flow / by routing u units of flow along the path p 








foreach arc e in p do ^(e) -s— l{e){l + 






end 




end 




end 












Figure 7: Garg-Konemann algorithm for maximum concurrent flow. 



Garg and Konemann prove the following lemmas. 

Lemma 14. If X* > 1, the algorithm in Figure^ terminates after at most t := 1 + A* log;^_|_£ 1/7 = 
1 + ^ logi+e phases. 

Lemma 15. After t — 1 phases, the algorithm has routed {t — l)di units of each commodity i. 
Scaling the final flow by logi_|_j I/7 yields a feasible flow of value A = j^^g^—^YJ^' 

Lemma 16. // A* > 1, then the final flow scaled down by \ogi_^^ I/7 is feasible and has a value of 
at least (1 — 3e)A*. 

As we ensured that 1 < A* < m, it is easy to see that the above lemmas imply that the 
algorithm in Figure [Tj after at most 1 + A* log^+g I/7 < 1 + mlogi+g I/7 phases, returns a (1 — 3e)- 
approximation for the maximum concurrent flow. Unfortunately, the bound of 1 + m log^^^ 1 /j 
on the number of phases is not sufficient to obtain the 0{{m + k)m£~'^) running time (in fact, it 
only establishes the time bound of 0((m + km)me~^)). To reduce this dependence of the number 
of phases on A*, Garg and Konemann use a halving technique developed in [24] . They run the 
algorithm and if it does not stop after T := 21og^^^ I/7 + 1 phases then, by Lemma [T^ it must 
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be that A* > 2. In this case, they multiply the demands by two, so A* is halved and still at 
least one. Next, they continue the algorithm and keep doubling the demands again if it does not 
stop after T phases. Clearly, since initially A* < m, after repeating such doubling at most logm 
times the algorithm stops, and thus the total number of phases is at most T log m. The number of 
phases can be reduce further to 0{T) by first applying the above approach with constant e to get a 
constant-factor approximation for A* - this takes 0(log^ m) phases ~ and then with at most 0{T) 
more phases the (1 — 3e)-approximation is obtained. Having established this bound on the number 
of phases, the bound of 0{{m + k)me~'^) on the running time of the whole algorithm follows easily. 



Input 


Graph G = {V,E), capacities u{e), commodity pairs {{si,ti)}i with demands di > 0, 








accuracy parameter e > 


Output: 


(Infeasible) flow / 


Initialize / ^ 0, and l{e) <- ^ for all arcs eeE, where 7 = {-^y^'^ and 6 := e{l + e) 


S 


ample sets {S'^jj^i piog„] to indicate the set P (see Definition [5]) 


Initialize (e/2, 1, 7/[/, 7')-ADSP data structure R as in Theorem [8] 


while D{1) < 1 do 




for i 


:= 1, . . . , fc do 






<- di 






while D{1) < 1 and > do 








p R.Path{si,ti, /3), where /? is guessed with binary search 








Find the bottleneck capacity li of p (* u ^ niin{(ii, miriegp u(e)} *) 








di ■i^ di ~ u 








Augment the flow / by routing u units of flow along the path p 








foreach arc e in p do i?.lncrease(e, ^^77^); '(e) <— '(e)(l + 






end 




end 




end 












Figure 8: Improved implementation of the algorithm from [71 



5.1 Our algorithm 

We present more efficient approximation scheme for maximum concurrent flow problem. Our 
improvement is based on making the algorithm from Figure [7] find the (approximately) shortest 
paths using (e, 1, 7/C/, P)-ADSP data structure instead of Dijkstra's algorithm, while using the 
same scaling procedures for A* as above. Our new implementation of procedure from Figure [7] is 
presented in Figure [8l Note that whenever the algorithm issues Path(u, •) request it uses binary 
search to find the (n, f )-accurate /3 that yields small enough error - see discussion after Definition 
[7] for more details. 

Let us define a{l) := (ijdistj(/), where distj(/) is the length of the shortest Si-ti path in V 
with respect to length function /. As it was the case for maximum multicommodity flow problem, 
we need to justify the fact that we focus our attention on shortest paths in V instead of the whole 
V. As before, the following lemma could be also seen as a consequence of weak duality among 
appropriate primal and dual formulations of the problem. 
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Lemma 17. With high probability, for any length function I, a{l) < D{l)/\* , where D(l) := 

Proof: Similarly to the proof of Lemma [TUl let us fix the optimal solution /* = (/j*, . . . , /^) that 
achieves the ratio of A*. By Lemma [H with high probability, each pj belongs to "P PI "PjQ), where 
pi, . . . ,pq are the fiowpaths of /* and i{j) is the corresponding commodity. Now, since /* obeys 
capacity constraints we have that 

k 

D{1) = Y,l{e)u{e) >Y,l{Pj)f:^,^{Pj) > Y.X*d,unnl{p) > X*a{l) 

e j 1=1 

and the lemma follows. I 
We are ready to prove the following theorem. 

Theorem 18. For any 0.15 > e > 0, there exists a Monte Carlo algorithm that finds a (1 — 4e)- 
approximate solution for maximum concurrent flow problem in expected time 0{{m + k)ne~'^ log U). 

Proof: 

As it was already mentioned, we will be using the algorithm of Garg and Konemann with 
Fleischer's improvement (as described above), in which we use the procedure from Figure [8] instead 
of the one presented in Figure [71 To bound the running time of this new algorithm, we recall that 
the preprocessing that ensures that 1 < A* < m can be performed in 0(min{A;, n}m) time. Also, we 
use the halving technique to ensure that the running time of the rest of the algorithm is bounded 
by the time needed to execute 0{T) = 0(log]^_,_j I/7) phases of the procedure in Figure [HI 

Now, it is easy to see that this running time is dominated by the cost of maintaining the data 
structure R, and the time needed to answer the queries Path(-,-,-) (note there is at most 0(n) 
lncrease(-, •) request per each Path(-, •, •) query). By Theorem[8|we know that the maintenance cost 
is 0(mn '°^^^^ ) = 0{mne~^{e~^ + \ogU)) = 0{mne~'^\ogU). To upperbound the time needed 
to answer Path(-,-,-) queries, we note that each such query results in augmentation of the flow, 
and each augmentation of the flow results either in increasing the length of at least one arc by 
(1 + e), or it is the last augmentation for given commodity. But no arc can have length bigger 
than (1 + e)/u{e), because l{e)u{e) < D{1) and we stop when D{1) > 1, thus the total number of 
augmentations of the flow is at most m[log(i+£) ^^^^J + ^ ' 0{T) = 0{me~'^ + fcT), which results 

in 0{{m + k)ne~'^ log log C//7) = 0{{m + k)ne~'^ log log U) needed to answer all Path(-, •, •) queries 
(including the time needed to perform each binary search for /3). As a result, the algorithm works 
in 0((m + k)ne~'^ log U) time, as desired. 

We proceed now to lowerbounding the value of the final flow / computed by our algorithm 
after scaling it down by the maximal congestion of the arcs. To this end, let, for given j, and 
1 < 9 < (Zj, fj,q be the flow of commodity i{j, q) that was routed along Si(^j^q)-ti(^j^q-^ path pj^g in g'-th 
augmentation of the flow / in phase j, where qj is the total number of flow augmentations during 
phase j. Let Ij^g be the length function / after routing the flow fj^g. For any j and q > 1, the fact 
that we always find the (sj^- q))-accurate /3 for the Path(sj(j g), tj^- /3) query, implies that 
Ij^g-iipj^g) < (1 + e)distj(j^g)(/j^q_i). Therefore, we have that 

D{lj,q) < D{lj^g^l) + 6ldistj(j- g)(/j- g_l), 

where 9 := e(l + e). 
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As a result, since the lengths of arcs can only increase, and in each completed phase we route 
exactly di units of commodity i, for all j > 1 we have that 

D{j) < D{j - 1) + eY,d^dist^{l,,g^) = D{j - 1) + 9a{lj,g.), 

i 

where -D(j) denotes D{lj^q_^). 

By Lemma [T7] we know that with high probability fS''^ ^ > A* for all j, thus we have that 



D{j) < 



D{j - 1) 



i-e/\* 

But, D{Q) = Y,e = so for j > 1 



m < 



7717 



(1 - e/\*y 



= (1+ ^ y-i 

< ■ e 

- (i-e/x*) 

777,7 ^(j-i) 

where the last inequality uses the fact that A* > 1. 

The algorithm stops at the first phase jf during which D{1) = l{e)u{e) > 1. Thus, 

l<D{jf) < ^--L_e^*a-«), 

which in turn implies 



A*(l-e)lni 



m7 



i/ - 1 > 

Since we had jf — 1 successfully completed phases, the flow produced by our procedure routes 
at least (j/ — l)di units of each commodity i. Unfortunately, this flow may be not feasible - it 
may violate some capacity constraints. But in our algorithm the length /(e) of any arc e cannot 
be bigger than (1 + e)/u{e). Thus, the fact that each arc starts with length /(e) := y/u{e) and 
each time a full unit of flow is routed through it, its length increases by a factor of at least (1 + e), 
implies that the congestion incurred at e can be at most [logi_|_j(l + e)/7j. Therefore, we see that 
the ratio A achieved by the final flow after scaling it down is at least 

A> > 



Llogi+,(l + e)/7j - ^logi+,1/7 
Plugging in 7 = (777/(1 — 9))~^/^ and unwinding the definition of 9 yields 

A>"-^<'+;f^;'"^ + -'>A->(l-4e)A-. 

which proves that the flow is indeed a (1 — 4e)-approximation of the maximum concurrent flow. 

I 
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5.2 Minimum cost concurrent flow 



As noted in [12] and [TT], the above approach for solving maximum concurrent flow extends easily 
to the case of the minimum cost concurrent flow problem in which we additionally have a cost 
function c(-) on arcs (routing one unit of flow along arc e incurs a cost of c(e)), and we are 
interested in finding maximum concurrent flow whose total cost is within some target budget B. 
In fact, as pointed out in [11], this extension can be easily adapted to handle multiple budgets Bj 
corresponding to different cost functions Cj. 

To make our algorithm for the maximum concurrent flow problem handle the budget constraint, 
we introduce a dual variable (p corresponding to it. Initially, (j) = l/B. Now, we modify our 
procedure in Figure [8] by stopping it once D{l,(j)) := X]eHe)M(e) + (j)B becomes at least one, and 
making it look for approximately shortest path with respect to the length function I + (pc instead 
of / - we do this just by maintaining an (e, 7/(5 + [/), 1, 'P)-ADSP data structure with respect 
to this new length function. Moreover, whenever some appropriate approximately shortest path 
p (zVi, for some i, is found by the algorithm, we augment the flow by routing along p the amount 
of flow being maximal value u such that: it does not overflow the bottleneck capacity miuggp n(e) 
of p, it does not exceed the remaining amount di to be routed for commodity i in this phase, and 
the cost of the flow - which is c{p) = XleGp ^(^) P^'- ^ach unit routed - does not exceed the budget 
B. After augmentation, we update di and the value of ^(e) for the arcs e of p in usual manner. 
Moreover, we would like to increase the value oi cp hy a factor of (1 + '^"^^^^ ) . Note however that 
each increase in (p results in increasing the length of all the arcs, thus we cannot afford to do the 
arc length updates each time (p changes. Instead, we do aggregate updates each time the value of (p 
grows by a factor of at least (1 + e) since the time the last aggregate updates were issued. Clearly, 
such update policy reduces the number of arc length increases to only m[log(i_)„£) 1/7]= 0(me~^) 
while introducing an acceptable (1 + e) multiplicative error to our estimates of the length of the 
paths with respect to the length function / + (pc. Finally, as it was the case for maximum concurrent 
flow problem, we have to ensure that the optimal ratio A* for the budget-constrained version of the 
problem is at least one and not too large. We do this by a procedure presented in [11] that finds 
min{/c, n^}-approximation to A* in time 0{m.m{n,k}m). 

Now, a reasoning completely analogous to the one for the maximum concurrent flow problem 
(see |12j for a highlight of straight-forward modifications in the proof) shows that, after proper 
scaling down at the end, we obtain a budget-constrained flow whose ratio is within (1 — 5e) of 
optimunjl, and the running time of the algorithm is 0{{m + k)ne~^ log(C/ + B)). Therefore, we get 
the following corollary. 

Corollary 19. For any 0.15 > e > 0, there exists a Monte Carlo algorithm that finds a (1 — 
he) -approximate solution for minimum cost concurrent flow problem in expected time 0{{m + 
k)ne-^log{U + B)). 

6 Construction of the Mmax, ^min, 7^)-ADSP data structure 

In this section we describe a step-by-step construction of the (5, Mmax, -^mim 'P)-ADSP data struc- 
ture (defined in Definition [7]) whose performance is described by Theorem [8l Let us fix our set 

®We get (1 — 5e)-approximation instead of (1 — 4£)-approximation (as it was the case in Theorem II 8 1) . because of 
the additional (1 + e)-multiphcative error introduced by our aggregate updates policy. 
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V := ljj=i" ^('S'ii2-'), where {Sj}j are the sampled subsets of vertices as in Definition O Note 
that for each j the expected size of Sj is 0{n\ogn/2^). 

For given length function I, and real number p, let us define /[^^ to be a length function with 
/[/'l(e) = \l{e)/p\p i.e. Z'''' corresponds to rounding-up the lengths of the arcs given by / to the 
nearest multiple of p. The motivation behind this definition is captured in the following simple 
lemma. 

Lemma 20. For any p > 0, length function I, and 1 < j < [logn], if there exists a path p G 
V{Sj,2^) of length l{p) then l^p/'^'\p) < l{p) + p. 

Proof: Consider a path p G V{Sj,2^), for some j, by definition we have 

1^'''''\P) = Y.l^''^'\e) < ^{l{e) + p/2^) < l{p) + p, 

since p can have at most 2^ arcs. I 
As suggested by the above lemma, the basic idea behind our (5, Mmax, -^-^mhn 'P)-ADSP data 
structure construction is to maintain for each j exact shortest paths from a set larger than 1-^(3 j, 2^) 
(namely, V{Sj)), but with respect to the rounded version /[''^^min/s^] gf the length function /, and to 
cap the length of these paths at Mmax + '^Mmin. Note that we do not require our [5, Mmax, Afmin, V)- 
ADSP data structure to output paths from V, thus this approach yields a correct solution. More- 
over, as we show in section [6?T1 using existing tools from dynamic graph algorithms we can obtain 
an implementation of this approach whose performance is close to the one postulated by Theorem 
[51 but with linear dependence of the maintenance cost on the ratio (as opposed to logarithmic 

one), and rather high service cost of lncrease(-, •) queries. We alleviate these shortcomings in section 
16.21 where we also prove Theorem [8l 

6.1 Implementation of the (5, Mmax, ^min, ^)-ADSP with Unear dependence on 

Mm ax 

An important feature of the rounded length function I^p^ for any p > 0, is that after dividing it by 
p we obtain a length function that assigns integral lengths to arcs. Therefore, we are able to take 
advantage of existing tools for solving decremental shortest path problem in dynamic graphs with 
integer arc lengths. We start by defining this problem formally. 

Definition 21. For any integer r > and a set of paths Q^V, let the decremental (r, Q)-shortest 
path problem ([r, Q)-DSPP for short) he a problem in which one maintains a directed graph G with 
positive integral weights on its arcs, and that supports four operations: 

• Distance{u,v), for u,v (z V: returns the length of the shortest u-v path in Q if this length is 
at most r, and oo otherwise. 

• lncrease{e,t), for e G -E and integer t > 0: increases the length of the arc e by t 

• Path{u, v), for u,v £ V: returns a u-v path of length Distance{u, v), as long as Distance{u, v) ^ 
oo. 

• SSrcDist{u), for u € V: returns Distance{u,v) for all v gV. 
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We state first the following lemma which is just a simple and known extension of the classical 
construction of Even and Shiloach [10] (see also [29] ) . 

Lemma 22. For any s and positive integer r, {r,V{{s}))-DSPP data structure can be main- 
tained in total time 0{mr) plus additional O(logn) per each lncrease{-, •) request. Each Distance{-, •) 
query can be answered in 0(1) time and each Path{-, •), and SSrcDist{-) query - in 0{n) time. 

For the sake of completeness, we prove the lemma in Appendix [Cl 

We combine now the above construction of (r, ■p({s}))-DSPP data structure to obtain imple- 
mentation of (r,P([/))-DSPP. 

Lemma 23. For any [7 C y and positive integer r, (r,'P(U))-DSPP data structure can be main- 
tained in total time 0{mr\U\) plus additional 0{\U\) per each lncrease{-, •) request. Each Distance{-, •) 
query can be answered in 0{\U\) time, each Path{-,-) - in time 0{n), and each SSrcDist{-) query - 
in 0{m -\- n log n) time. 

Proof: We maintain (r, 'P({s}))-DSPP data structure Rs as in Lemma [22] for each s €U. Clearly, 
the maintenance cost is 0{mr\U\) plus additional 0(|J/|) per each lncrease(-, •) operation - we just 
forward each lncrease(-, ■) operation to each Rg. Now, to serve Distance(ti, v) request we just issue 
Distance(ii, query to each Rg that we maintain and return the answer yielding minimal value. 
Answering Path(u, -y) request consist of just querying each Rs with D\stance{u,v), and forwarding 
Path{u,v) request to Rg returning the minimal distance. Finally, to serve SSrcDist(ii) query, we 
construct a graph Gu,u that consists of G equipped with current length function and additional 
vertex u' from which there is arc to each s U with length corresponding to the distance from u 
to s with respect to /. Note that construction of the graph Gu,u can be performed in 0{m) time - 
in particular the length of each arc {u',s) can be obtained by querying Rg with Distance(ti, s). It 
is easy to see that if we compute single-source shortest path distances in Gu,u from u' to all v &V 
using Dijkstra's algorithm then we can obtain the value of Distance(ti, for each v V hy just 
returning the computed value if it is at most r and (n, v) is a source-sink pair (so, the corresponding 
u-v path is in V); and returning oo otherwise. Obviously, the total time required is 0{m-\-nlogn), 
as desired. I 
We proceed now to designing an implementation of (5, Mmax, -^mim 'P)-ADSP data structure 
that meets the time bounds of Theorem [8] except it maintenance time has linear - instead of 
logarithmic - dependence on ix^, and the time needed to serve lncrease(-, •) request is much 
larger. 

Lemma 24. For any 6 > 0,and Mmax > SMmm > we can maintain {5, Mj^^^^, M^iji,V)-ADSP 
data structure in total expected time 0{mnj^f^) plus additional 0{n) per each lncrease{-, •) request. 

Each Distance{-,-,-) and Path{-,-,-) query can be answered in 0{n) time, and each SSrcDist{-, ■) 
query - in 0{m) time. 

Proof: Let / be the length function of our graph G. For each 1 < j < [logn] we maintain 
a {\Mj / pj],V{Sj))-DSFF data structure Rj with respect to length function P := l^^^^pj, where 
Pj := (5Mmin/2'', and Mj := Mmax + ^-^^^min- Note that by definition P is integral, so we are allowed 
to use the data structure from Lemma [231 Moreover, by Lemma [23] and Lemma [2U] applied with 
p = Pj2^ , we see that if there is an s-t path p in V{Sj,2^) of length l{p) € [Mmim -^max] then Rj 
maintains a s-t path p' € ^{Sj) whose length with respect to I is at most l{p) + 2^ pj = l{p) + SM^^^^. 
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Now, to answer a Distance(u, t;, /3) query we just issue an Distance(u, f ) query to all Rj and 
return the value that is minimal after multiplying it by the respective value of pj. Note that we 
are ignoring the value of (3 here - since (3 > M^[^, the accuracy of our answers is still sufficient. 
Similarly, as long as Distance(n, v, /3) ^ oo, we answer Path(n, v, /3) query by just returning the result 
of Path{u,v) query forwarded to Rj whose Distance(n, f ) (after multiplying by pj) is minimal. We 
implement answering SSrcDist(n, /3) query by just issuing SSrcDist(n) queries to each Rj, and for 
each V (zV we return the reported distance that is minimal (after multiplication by respective pj). 
Finally, whenever there is a lncrease(e, oj) request, we increase the length function I accordingly and 
issue lncrease(e, \{l{e) +oj)/aj'] — \l{e)/crj'\) request to each Rj. 

To analyze the performance of this implementation, we note that by Lemma[23l each Distance(-, •, • 
requires 0(^j- \Sj\) = 0{n) time, each Path(-, •, •) - 0{n) time, and each SSrcDist(-, •) - 0(m) time. 

Also, the cost of serving lncrease(e, w) request is 0{J2j = 0{n). As a result, the total expected 
maintenance cost is, by Lemma [ 



0{Y: mE[\S,\]\M,/p,]) = 0{mn J] il^) = Oirnn^p^), 

where we used the fact that expected size of Sj is 0(n log n/2-'). The lemma follows. I 
6.2 Proof of Theorem [8] 

As we mentioned in section [3l in our applications the ratio of Mmax to Mmin can be very large i.e. 
r2(n^/'') for e < 0.15. Therefore, the linear dependence on this ratio of the maintenance time of the 
(5, Mjnaxi -^min; 'P)-ADSP data structure from Lemma [23] is still prohibitive. To address this issue 
we refine our construction in the following lemma. Subsequently, we will deal with large service 
time of lncrease(-, •) requests in the proof of Theorem [HI 

Lemma 25. For any 5 > 0, Mmax > 2Mmm > 0, (5, Mmax, Mmin, data structure 

can he maintained in total expected time 0{mn ^^m^'^/^^mm ^ piy^g additional O(nlog^) per each 
lncrease{-,-) request in the processed sequence. Each Distance^-,-,-) and Path{-,-,-) query can be 
answered in 0{n) time, and each SSrcDist{-, •) query - in 0{m) time. 

Proof: 

For each <b < [log^^J, let us define M^;^ := 2''Mmin, and M^ax = 2''+2Mmin- We wih 
maintain for each 6, a (5, M^g^^^, M^j^, 'P)-ADSP data structure Ri, as in Lemma [Ml Intuitively, 
we divide the interval [Mmim Mmax] into exponentially growing and partially overlapping inter- 
vals [M^jj^, Mmax], and we will make each R}, responsible for queries with /? falling into interval 

[<in,^max/2]. 

More precisely, upon receiving Distance(u, i), Path{u, v, f3), or SSrcDist(n, /3) request, we just 
pass it to the unique Rb with M^j^^ < (i < Mmax/2, and report back the obtained answer. By Lemma 
[Ml and definition of {5,M^^,M^:^^,V)-KDSY' data structure, the supplied answer is correct, and 
the service cost is within desired bounds. Also, the part of the total expected maintenance cost that 
is independent of the number of lncrease(-, •) requests is at most O [mn ^'^m^x/A/mm ^ needed. 

Therefore, it remains to design our way of handling lncrease(-, •) requests, and bound the corre- 
sponding service cost. A straight-forward approach is to update the length function / accordingly 
upon receiving lncrease(e, w) request, and forward this request to all R^. This would, however, 
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result in 0(n log 4j^) service cost which is slightly suboptimal from our point of view. Our more 
refined implementation of handling lncrease(e, w) request is based on two observations. First, we 
note that if at any point of time the length of arc e increases to more than 2M^^^ for some b, 
we can safely increase the length of this arc in to oo without violating the correctness of the 
answers supplied by Rh - we call such event deactivation of e in Rfy. Second, we don't need to 

forward lncrease(e, w) requests to Rt for which l{e) + a; < fpiog^-i, where = — ^f^, and /(e) is the 
current length of the arc e. This is so, since the construction of R^s from Lemma [Ml will have the 
rounded length /''^j'(e) of e still equal to aj, for every j. Therefore, instead of passing to such R;, 
lncrease(e, w) requests each time they are issued, we just send an lncrease(e, w') request to Rb once 
the length of e exceeds (^'^i^g ; where uj' is the total increase of the length of e from the beginning 
up to the current value of l{e) - we call such an event activation of e in R^. 

In the light of the above, our handling of a lncrease(e, w) request is as follows. Let 6_ be the 
largest b with 2M^^^ < l{e) + uj, and let 6+ be the largest b with /(e) + w > Cpiog^-i- We start by 
deactivating e in all Rh with 6 < 6_ in which e wasn't already deactivated, and activating e (by 
increasing the length of e to /(e)) in all Rb with 6_ < 6 < 6+ in which it wasn't activated yet. Next, 
we issue lncrease(e, w) request to all Rb with b^ < b < 6+, and we increase /(e) by uj. It is not 
hard to see that by the above two observations, this procedure does not violate the correctness of 
our implementation of (5, Mmax> -^mim 'P)-ADSP data structure. Now, to bound the time needed 
to service lncrease(-, •) request we note that each arc e can be activated and deactivated in each Rb 
at most once, and each such operation takes 0{n) time. So, the total cost of these operation is at 
most 0(mn log ^f^) and this cost can be amortized within the total maintenance cost. To bound 
the time taken by processing the lncrease(e, w) requests passed to all Rb with b- < b < b^, we note 
that /(e) + a; < 2Mmax^ < 2^+'^a''r^^ /d for any j, thus 6+ - - 1 < log ^^'°7^^' , and the total 
service time is at most 0(n log |), as desired. The lemma follows. 

I 

We are ready to prove Theorem [HI 
Proof: [of Theorem[H] We maintain ((5/2, Mmaxj AfmiiD ^)-ADSP data structure R as in Lemma [2S1 
While serving the sequence of requests, we pass to R all the Path(-, •, •) requests and return back 
the answers supplied by R. Similarly, we pass Distance(-, •, /3) and SSrcDist(-, /3) to R, and return 
back the values supplied by R with ^ added to each of them. Finally, in case of lncrease(-, •) 
requests we pass them to R in an aggregate manner. Namely, in addition to / - the (evolving) 
length function of the graph G - we also maintain an aggregated length function /. Initially, / = /, 
and later, as / evolves in an on-line manner, we increase /(e) to /(e) for given arc e, each time 
/(e) becomes greater than max{(l + 5/8)/(e), (5Mmin/4ra}. Note that this definition ensures that we 
have always /(e) < /(e) < (1 + 5/8)/(e) + 6M^i^/An for any arc e. Now, instead of passing to R 
an lncrease(e, w) request each time it is issued, we only issue an lncrease(e, /(e) — /(e)) request to 
R each time the value of /(e) increases to /(e). In other words, we make R to work with respect to 
the length function / instead of /. 

Clearly, by Lemma [25] the time needed to answer Distance(-, •, •), Path(-,-,-), and SSrcDist(-, •) 
queries is within our intended bounds. Also, we can raise the length /(e) of an arc e to oo once its 
length exceeds 2Mmax, without violating the correctness of our implementation of {6, Mmax) -^mim P)- 
ADSP data structure. Thus, for given arc e, the length /(e) can increase at most riog(i+<5/8) ^if^l + 
^ Q^ iogAf.nax/M„,in -^ ^.^gg^ Therefore, we issue at most (^(m ^"^^'^'"^/^^""" ) lncrease(-, •) requests 
to R, which by Lemma [25] takes at most d{mn^-^^^^^^^^^f^^^) time to process. As a result, the total 
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maintenance time of our construction is 0(mn— — ^i^^Z — 2ii£.) pi^g additional 0(1) time per each 
lncrease(-, •) request in the sequence, as desired. 

To prove that our construction is a correct implementation of ((5, Mmax; -^mim ^)-ADSP data 
structure, consider some s-t path p in V whose length l{p) is at most 2/3 for some f3 € [Mmin, Mmax/2]. 
Now, upon being queried with Distance(s, t, /3) request, our data structure will return a value 
d' = d + 5/3/2, where d is the value returned by R as an answer to Distance(s, t, j3) request passed. 
Since i{p) < l{p), we have d' = d + 6/3/2 < l{p) + 6/3/2 + 6/3/2 < l{p) + 6/3, as desired. Moreover, 
upon Path(s,t,/3) query we return a path p' with l{p') < d. This means that 

Kp) < 5^(1 + S/8)l{e) + <5Mmin/4n < (1 + 6/8)l{p') + 6/3/4 < (1 + 6/8)d + 6/3/4 <d + 6/3/2 = d', 

eGp' 

since d < l{p) + 6/3/2 <2/3 + 6/3/2 < 3/3 for 5 < 1. The theorem follows. 

I 
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A Proof of Theorem [9] 

Proof: [of Theorem!!] Let G = {V, E) be the graph of our interest, and let li be the length function 
of G after processing i requests from our sequence. Consider a u-v path p, for some u,v , that is 
the shortest u-v path in G with respect to li for some i. Our construction is based on the following 
simple observation: for any 5 > 0, and for all i' > i, as long as for all arcs e of p, li'{e) is at most 
{1 -\- 6)li{e) , p remains to be a (1 + 5)-approximate shortest u-v path in G with respect to Note 
that we have different (n, v) pairs, and each of m arcs can increase its length by a factor (1 + 6) 
at most [log(;^^5) L] times. Therefore this observation implies that for any 5 > there exists a set 

Q{S) of 0(mn^^^^|-^) paths such that for any (n, v) and i there exists a u-v path p in Q{5) that has 
length li{p) within (1 + 6) of the length /j(p*) of the shortest (with respect to li) u-v path p* in G. 

In the light of the above, our solution for the decremental all-pair shortest path problem is 
based on maintaining (e/3, Ln, 1, Q(e/3))-ADSP data structure R, where Q(e/3) is the set con- 
structed as in Definition [5] after we make V to be the set of all paths in G and change the sampling 
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probabilities pj to min{ 2^'^^^^^ ' ^J' ^o^' i — !)•••) [log'^l- Note that by reasoning com- 
pletely analogous to the one from the proof of Lemma EJ we can argue that with high probability 
2(^/3) Q Q(e/3). Also, by straight-forward adjustment of the construction from Theorem [8] we 
obtain an implementation of {e/3,Ln, 1, Q(e/3))-ADSP data structure that has total maintenance 
cost of 0{mn^^^j^) plus 0(1) time per each lncrease(-, •) request, and that answers Path(-, •, •) and 
Distance(-, •, •) queries in 0(n log log^^^^) L) time. Therefore, if we process the request sequence 
by just passing arc length increase requests to R, and answering each u-v shortest path query by 
issuing to i? a Path(n,f,/3) query - where (u, ?;)-accurate /3 is found through binary search using 
O(loglogL) Distance(u, f , •) queries (see discussion after Definition [7]), then the Definition [7] ensures 
that we obtain a correct (l + e)-approximate solution for decremental all-pair shortest path problem 
whose performance obeys the desired bounds. The theorem follows. 

I 



B Extension to weighted maximum multicommodity flow 

One may obtain a linear programming formulation of weighted maximum multicommodity problem 
by simply changing the objective value of LP ([T|) to Yli=i ^« SpG'Pi fp- Note that the dual of this 
modified LP is the LP ([2]) where constraint corresponding to p G Vi, for some 1 < i < k, becomes 
5^eep K^) — '^i- This suggests that in the modified algorithm our criterion for selecting paths along 
which we augment the flow should be (approximate) minimization of the length of the path divided 
by its corresponding weight. As a result, we need to prove an analog of Lemma [TO] that will certify 
that (with high probability) there is always a path in V whose ratio of length to the corresponding 
weight is small enough. 

Lemma 26. With high probability, for any length function I, and weights wi, . . . ,Wk, there exists 
a Si-ti path p & V, for some 1 < i < k, with < ^^^jp^^, where OPT is optimal value of the 
maximum weighted multicommodity flow. 

Proof: Let /* = {ff, . . . ,/^) be some optimal multicommodity flow with = OPT. By 

Lemma Owe know that with high probability V contains all the flowpaths pi, . . . ,pq of /*. The 
fact that /* has to obey the capacity constraints implies that X]e'(^)^(^) — Yl'j=iKPj)f*{Pj)- 
But OPT = J2i'^i\fi \ ~ Yl'j=i^i{j)f*(Pj)^ where i{j) is such that pj € "PiQ)- Therefore, simple 

KP") l(e)u(e) m 

averaging argument shows that there exists j* such that — - — < r^oir , as desired. I 
Similarly to the case of Lemma \T0\ the above lemma can also be seen as a consequence of weak 
duality between primal LP formulation of the problem, restricted to paths in V, and corresponding 
dual linear program. We are ready to prove the corollary. 

Proof: [of Corollary [13] We modify our algorithm in Figure [5] as follows. We decrease the value of 
7 to (1 + e)W/{{l + £)nWy^^ . Also, a will be now our lowerbound on mini<j<fc miupgp. l{p)/wi. 
We still terminate the algorithm when a becomes at least one. This means that some of the paths 
we are interested in can have length up to W. As a result, we make i? to be a (e/2, W^, 7, "P)- 
ADSP data structure (as opposed to (e/2, 1, 7, P)-ADSP). Also, for given source-sink pair (sj,tj), 
the admissibility for a condition that is checked in procedure Find Admissible Pair becomes: R 
upon querying with D\star\ce{si,ti,Wj.a) query returns a value that is at most (1 + £)wia, where 
Wj = (3/2)-^ for j = 1,..., UoS3/2^J; ^i^d Wj^ is the largest Wj that is smaller than Wi. In 
particular, we change all the Distance(sj, tj, a) (Path(sj, tj, S) resp.) queries to D\stance{si, ti,Wj^a) 
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(Path(sj, tj, Wj.a) resp.). Also, whenever our previous algorithm was making SSrcDist(,s, a) cah, we 
make it instead issue SSrcDist(s, Wja) cahs for all j = 1, . . . , [log3/2 W\ and check admissibility of 
all the source-sink pairs in I{s) using answers to these calls. 

The running time analysis of our original algorithm from the proof of Theorem 1121 can be easily 
adapted to show that the expected running time of the modified algorithm is 0{'mne~^ log^ W). 
The only differences are: the smaller value of 7, the fact that in Find Admissible Pair procedure we 
make [log3/2 W\ SSrcDist(-, •) queries instead of one, and that length of an arc can become as large 
as (1 + e)W so there can be as many as m[log(^i^^-^ (i+£)ty j _ Q(^^g-2 Jog VK) flow augmentations. 

To prove the bound on the quality of returned solution, for j > 1, let hj — hj-i be the increase 
in weighted flow value after jth augmentation of the flow along path pj G where is the 

commodity to which pj corresponds, i.e. hj — hj-i = wn^j-^Uj, where Uj is the amount of the flow 
we routed in j'th augmentation, and /iq = 0. Let Ij be the length function / after jth augmentation 
of the flow, and let a(j) = mini<j<fc mm^^^^j^ lj{p)/wi. Finally, let OPT be the value of optimal 
solution to our instance of the weighted maximum multicommodity flow problem. 

By argument analogous to the one in the proof of Lemma \TT\ we can prove that lj-i{pj) < 
(1 + e)wi(^j-^a{j — 1). Now, if we define, as before, D{j) := J2e lj{e)u{e) to be the volume of G with 
respect to Ij , then for j > 1 we have 



D{3) = ^lj-i{e)u{e) + e^lj-i{e)uj 

< D{j - 1) + ewi(j-)a{j - l){hj - hj-.i)/wii^j) 
= D{j-l)+9a{j-l){hj-hj^i), 

where, as before, 6 := e{l + e). 

Now, we can apply Lemma [26] to length function Ij — Iq, to conclude that OPT < (cf. 
(21) in the proof of the Lemma [TT]) . By continuing exactly as in Lemma [11] (and keeping in mind 
that maximum length of an arc can be {1 + £)W now) we get the following bound on the value of 
the final feasible flow hf. 

ln{n-f)-^OPT 

- J\ il+e)W ■ 

With our choice of 7, this is at least (1 — 3e)0PT, as before. I 

C Proof of Lemma [22 

Proof: [of Lemma [22] 

First, we notice that to prove the lemma it is sufficient to show that we can maintain, within 
desired time bounds, the single-source shortest paths tree of all v-s paths that have length at 
most r, for any v € V. Indeed, once we achieve this, it will also imply that we can keep the 
single-source shortest paths tree of all s-v paths having length at most r, for any v V. Now, to 
implement (r, P({s}))-DSPP data structure we just maintain both single-source shortest path trees 
and whenever queried Distance(n, f ) we answer Distance(ii, s) -I- Distance(s, if this sum does not 
exceed r and (n, v) is a source sink pair (i.e. the corresponding u-v path is in V); and 00 otherwise. 
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Note that our trees allow finding Distance(u, s) and Distance(s, u) in 0(1) time. Similarly, we 
can answer queries Pat\r\{u,v), as long as Distance(n, s) + Distance(s, < r, by just concatenating 
paths Path(u, s) and Path(s,u) that we can obtain from our trees in 0{n) time. Finally to answer 
SSrcDist(n) query we just issue a Distance(«, u) query - that we already know how to handle - for 
each V V. It is easy to see that all the running times will fit within the desired bounds as long 
as our maintenance of single-source shortest paths tree will obey these bounds. 

Our way of maintaining such a single-source shortest path tree of all v-s paths is a simple 
extension of the classical construction of Even and Shiloach [10] (see also |29j ) who showed how to 
dynamically maintain in an unweighted directed graph, a decremental single-source shortest paths 
tree up to depth d, in 0{md) total running time. 

In our data structure, each vertex v will keep a variable d[v\ whose value will be always equal 
to f 's current distance to s. Moreover, each vertex v keeps a priority queue Q[v\ of all its outgoing 
arcs, where the key of a particular arc (f , u) is equal to the current value of d[n] + u)). We want 
the queue to support three operations: Insert{e,t) that adds an arc to a queue with key equal to 
t, FindMin - returns the arc with smallest value of the key, and SetKey{e, t) that sets the value of 
the key of arc e to t. By using e.g. Fibonacci heap implementation of such queue, FindMin can be 
performed in 0(1) time, and each of the remaining operations can be done in 0(log77,) amortized 
time0 

The initialization of the data structure can be easily done by computing the single-source 
shortest path tree from s using Dijkstra algorithm and inserting arcs into appropriate queues, 
which takes 0(m log n) time. Also, Distance(-, s) queries can be easily answered in 0(1) time by 
just returning d[v]. Finally, the implementations of the Path(-,s), and lncrease(-, ■) can be found 
in Figure [9j Clearly, answering Path(-,s) query takes at most 0(n) time. Now, the total time 
needed to serve w lncrease(-, •) request is at most O(logn) times the total number of Scan{-) calls. 
But, since for a particular arc e = {u,v) Scan{e) is called only if either lncrease(e, •) was called; or 
d[v] < oo and d[v] increases by at least one, we see that this number is at most m{r + 1) + w, which 
gives the desired running time. 

I 



^Note that SetKey{e,t) operation can be translated to 'standard' priority queue operations as: decrease the key 
of e by a value of oo, extract the minimal element, and insert e again with new value of the key. 
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Procedure Path(w,s): 
if u = s then 
I return an empty path 
else 

e = {v,u) Q[v].FindMin 
return Path(u, s) U {e} 
end 

Procedure lncrease(e, t): 

/(e) ^ l{e)+t 
Scan(e) 

Procedure Scan{e) : 

Q[u].SetKey[e, d[v] + /(e)) 
/ = {u,v') ^ Q[u].FindMin 
if d[v'] +l{f)>r then 

I d[u] ^ CXD 

end 

if d[v']+l{f) > d[u] then 
d[u] ^ d[v'] + l{f) 

foreach arc /' incoming to u do Scan{f') 
end 



Figure 9: Implementation of procedures Path{v,s) and lncrease(e, t), where e = {u,v) 
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